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Abstract 

This paper is concerned with the auto-covariance function 
(ACVF) of a regime switching AR (1) process. In this model, 
two independent Markov chains govern on auto-regressive 
coefficient and standard deviation of white noise process. 
Our approach to solve this problem is to obtain the ACVF of 
a AR(1) model with time varying parameters and then to 
extend this result to regime switching case. An application of 
our formulae in model selection is proposed. Finally, a 
conclusion section is also given. 
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Introduction 

This condition that a model for a financial time series 
remains fixed over a very long period rarely happens 
in practice. Indeed, economic variables may behave 
differently during a long-run time. This fact makes 
economists do structural change analysis. Abrupt 
changes are a fundamental feature of financial data. 
These shifts may happen in mean or variance or both 
or in the covariance structure of a financial time series. 
There are many useful techniques for modeling shifts 
such as change point analysis, use of dummy variables, 
threshold analysis and regime switching method, 
referring to Hamilton (1994). 

Usually, the distributional properties of a financial 
time series relate to its mean and auto-covariance 
functions (ACVF). The ACVF is an important function 
for studying the covariance structure of each process. 
For example, it is useful tool for determining the type 
of every process. For a review on applications of 
ACVF, referring to Brockwell and Davis (2002). 

As described in above, a useful approach to model a 
financial time series is to consider different behaviors 
(structural break) in one subsample (or regime) to 
another. If the dates of the regimes are known, 



modeling can be done using dummy variables. 
However, when these dates are unknown, or they are 
not fixed, we can consider them as random variables 
and a regime switching model may be applied. 

Regime switching methods are very useful for 
modeling the movement of price of a specified stock 
market or formulating the dynamic correlations or 
pricing volatility swaps under Heston's stochastic 
volatility model, referring to couch (2009) and Pelletier 
(2004). 

Derivation 

In this section, we consider the derivation of ACVF for 
RS-AR (1) time series. Firstly, we derive a formula for 
a time varying AR (1) process and finally, then we use 
this function to derive the ACVF formula for RS-AR (1) 
process. Therefore, consider a first order zero mean 
regime switching auto-regressive RS-AR (1) process 
defined by 

Y t = <f> s iY t -l + ffgaZi, 

where 

\4> r \ < |4>| < 1 a r < M 

for all integers number r. Here, * and °* 'are two 
independent Markov chains with the same state space 

®- Let ^ f be a white noise process with zero mean 

and variance " In this model, we assume that 1 * 

V S' 1 

is independent of if -i and * and -f are 

independent of ^ 1 and^' - In this paper, we are 
going to derive an expression for ACVF in this non- 
stationary process, i.e., 

7f (h) = cov(Y t+ ^Y t ), h = 0, ±1, ±2, ... . 

The regime switching model deals with the capturing 
structural changes in the underlying financial time 
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series using the time ordered observations. An 
example is Cryer and Chan (2008) who applied this 
type of time series for modeling the stock returns. In 
this model, the parameters such as mean and/or 
volatility vary through the sample; in fact they are 
functions of some Markov chain processes. This model 
has been applied in regression analysis, Box-Jenkins 
time series and as well as in GARCH modeling of 
financial problems. An excellent reference in this field 
is Zivot and Wang (2006). 

To derive the ACVF, first consider a zero mean AR (1) 
process with time varying parameters defined by 



Therefore, with probability one, we conclude (by 
letting k goes to infinity) that 



where 



and 



5*| < \6*\ < 1 and ^* < M* 



Z% -WN(0,ff* 2 ) 



Suppose that 



and note that 



E{Y*) =0 



v* = var(Y t *) < 0* a u t *-i + M*a 
Therefore, we see that 

v* < MV t2 (l + f a +...+f 2 ( t - 1 )j + Ai 

Here, UB means the upper bound. 
Using a recursive solution, we find that 

< \f\*. k + l >UB 
— * f as A: — * oo, 

where the coefficients are given as follows 

i 

3=1 



r* 



i=0 

There is another way to obtain this equation. Let B 
denote the backward operator. Note that 

which equals to (using Taylor expansion) 

CO i OO 

n* = E n ^-; + i^to^) 

Using the above equation, it is not difficult to see that 

CO 

Now, we are in a position to calculate the ACVF. 
Define the sigma-field F constructed using the whole 
information of two Markov chains up to time t as 
follows 

and let 

^ = ^L)IX =1 <i>(sL j+ i.)- 

It is easy to see that 



E(Y t Y t+h \F)=v 2 J2 D ' D *+*- 
Therefore, using total probability law, we obtain 

CO 



i=0 



However, it seems that calculating the above 
expectation will be hard in practice. In the following, 
we employ a technique which simplifies calculation of 
this mean. To this end, supposing that U(t) is a 
Markov chain with a finite state space. To calculate 



we first suppose that p=2 then 
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Next, let p=3 



= EibWiEiUzpuUi)) 

= E(U 1 U2E(U%\U i ')) : Markov property 



Since the conditional distributions exist, this 
expectation can be calculated. For other choices of p 
the same method is applied. This technique is 
applicable for 

for some measurable functions 

frj, j = l f 2,... ; P ? 

for more description on this method, referring to Iacus 
(2008). Note that, in practice, we can estimate the 

using a Monte Carlo technique including some 
variance reduction methods, referring to Brazzale et al. 
(2007). 

Application 

In this section, we use an application of formulae 
obtained from the previous section. The ACVF of RS- 
AR(1) is a function of expectation of some product of 
Markov chains. As shown in the preceding, this 
expectation decays exponentially, as h goes to infinity. 

Therefore, this property is transferred to ACVF. Up to 
this time, the ACVF behaves like the ACVF of a 
ordinary AR(1). However, the rate of decay to zero is 
different from time point f to t + 1. 

Thus, a unified strategy for selecting a RS-AR (1) is to 
inspect the time series plot of the series. If it appears 
that there are some changes in its level, mean or 
variance, and if there is an exponential-wise decay to 
zero with different rates, then RS-AR (1) model may be 
appropriate. Estimate the related model parameters 
and do suitable statistical inference. 

In the following examples, we see that how, we can 
understand the existence of RS-AR (1) model from 
time series and ACF plots. 

Example 1. Here, we consider the seasonally adjusted 
percentages of growth rate of the U.S. quarterly real 
GNP from the second quarter of 1947 to the first 
quarter of 1991. By plotting the time series (referring to 
Potter (1995)) It is seen that most of growth rates are 



positive. This idea motivates us to use an regime 
switching model. 

Example 2. Here, we use the S-plus software to 
simulate an AR-RS (1) model, coefficients 0.3 and 0.5 
for state 1 and 2, respectively. The elements of 
transition probabilities matrix are assumed to be 0.5. 
The following plot shows the ACF of this time series. 

Series : x 



20 
Lag 



It is seen, there is a considerable value for ACF in k=l 
and the ACF decays after 1 exponentially. This 
suggests a first order regime autoregressive switching 
model. 

Conclusion 

In this paper, we employ the auto-covariance function 
of an AR (1) regime switching model. Its behaviour is 
studied and it is seen that the auto-covariance function 
is different from zero significantly and it decays 
suddenly after h=l. These properties are used to 
specify an AR-RS (1) model. 
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